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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address - 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136 (a). In no event, however, may a reply be timely filed 

after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will 

be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and vwil expire SIX (6) MONTHS from the mailing date of this 

communication. 

- Failure to reply within the set or extended period for reply will, by statute; cause the application to become ABANDONED (35 U.S.C. § 1 33). 



3) 0 Since this application is in condition for allowance except for fomnal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1 935 CD. 1 1 , 453 O.G. 213. 

Disposition of Claims 

4) n Claim(s) 1-30 is/are pending in the application. 

4a) Of the above claim(s) 17-30 is/are withdrawn from consideration. 

5) \3 Claim(s) is/are allowed. 

6) n Claim(s) 1-16 is/are rejected. 

Claim(s) is/are objected to. 

8) n Claims 17-30 are subject to restriction and/or election requirement. 

Application Papers 

9) 0 The specification is objected to by the Examiner. 

10) 0 The drawing(s) filed on is/are objected to by the Examiner. 

1 1) n The proposed drawing correction filed on is: a)n approved b)n disapproved. 

12) n The oath or declaration is objected to by the Examiner. 

Priority under 35 U.S.C. § 119 

13) n Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d). 

a)n All b)n Some * c)\3 None of the CERTIFIED copies of the priority documents have been: 

1. n received. 

2. n received in Application No. (Series Code / Serial Number) . 

3 □ received in this National Stage application from the International Bureau (PCT Rule 17.2(a)). 
* See the attached detailed Office action for a list of the certified copies not received. 

14) n Acknowledgement is made of a claim for domestic priority under 35 U.S.C. & 119(e). 



Status 



!)□ Responsive to communication(s) filed on 10/4/99 . 

2a)n This action is FINAL. 2b)l3 This action is non-final. 



Attachment(s) 



14) ^ Notice of References Cited (PTO-892) 

15) (3 Notice of Draftsperson's Patent Drawing Review (PTO-948) 

16) S Information Disclosure Statement(s) (PTO-1449) Paper No(s) 6 . 



17) O Interview Sumnnary (PTO-413) Paper No(s). 

1 8) □ Notice of Informal Patent Application (PTO-1 52) 

19) □ Other: 



U.S. Patent and Tradennark Office 

PTO-326 (Rev. 3-98) 
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1- This action is responsive to communications: election filed 10/4/99 to the 
application filed on 5/30/97. 

2- Claims 1 7-30 are withdrawn from further consideration by the examiner, 37 CFR 
1 .142(b) as being drawn to a non-elected invention. Election was made without 
traverse in Paper No. 8. 

Drawings 

This application has been filed with informal drawings which are acceptable for 
examination purposes only. Formal drawings will be required when the application is 
allowed. 

Claim Rejections - 35 (JSC § 101 

35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 10-16 are rejected under 35 U.S.C. 101 because the claimed invention is 
directed to non-statutory subject matter. They disclose a hierarchical data file structure 
that encapsulates different data files to form a multimedia document, in which each data 
file comprises a document and objects embedded in the document. 



Claim Rejections - 35 USC § 103 
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The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1, 4, 9-14 rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kauffman (US Pat No. 5,586,235, 12/17/96) in view of Berry et al. (US Pat No. 
5,692,205, 11/25/97). 

With respect to independent claim 1 : 

Kauffman discloses a standard document structure for organizing and storing all 
information in documents used in a digital multimedia system (col 2, lines 35-40) in 
which the structure applied to documents regardless of whether the information is text, 
video, audio, still pictures, graphics, or any other type of information (col 4, lines 47-52) 
and the document is organized in a hierarchical manner (col 4, lines 65-67; col 5, lines 
1-20); 

Kauffman does not disclose the encapsulating in a multimedia document a file support 
object. Berry discloses a method to integrate multimedia presentations into an object 
oriented user interface which includes multiple polymorphic objects which each has 
associated encapsulated data and functionality (col 2, lines 27-33). 
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It is noted that Kauffman and Berry fail to disclose the first file object and the second file 
object including information in a first file format and information in a second file format, 
and these objects are encapsulated in a multimedia document. However, it would have 
been obvious to one of ordinary skill in the art at the time of the invention was made to 
have combined Berry to Kauffman because Kauffman provides a method to organize 
multimedia documents having hierarchical structure and Berry provides a method to 
integrate multimedia presentations into an object oriented user interface which includes 
multiple polymorphic objects which each has associated encapsulated data and 
functionality thus motivating the including the first object and the second object in the 
structure of a multimedia document. 

With respect to claim 4, which is dependent on claim 1 , Berry discloses that there are 
displayed pictorial representations of multiple data views of a polymorphic object. After 
selecting polymorphic object and the "Look at" command and the "Lyrics" subcommand, 
a second window will open, overlying window, and the lyrics of the Christmas carol 
associated with the selected object is displayed (col 4, lines 27-40, figures 3A, 3B). It is 
noted that Berry fails to use the same terminology: creating an exclusionary area within 
the window, and locating an object within the exclusionary area, the object being 
selected from a group of data objects including a framed image, a slide show, framed 
text, sound data, a separator, or a hyperlink. However, it would have been obvious to 
one of ordinary skill in the art at the time of the invention was made to have applied 
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Berry because Berry shows the display of object within a window and the object 
displayed is selected from a group of data objects including text, or sound data. 

With respect to claim 9, which is dependent on claim 1 , Berry also discloses the 
multimedia support within data processing system typically involve providing a "player"' 
interface for each multimedia object. For example, audio and video are typically treated 
as individual objects and control panels representing cassette tape players, video 
cassette recorders, laser disc players and each such device are graphically displayed in 
order to permit the user to access recorded information by graphically manipulating the 
audio or video object with the "player"' device (col 1 , lines 28-36). It is noted that Berry 
fails to disclose the creating an unknown object in the data file, and locating the player 
data within the unknown object defining a player that plays the unknown object. 
However, it would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to have applied Berry because Berry provides a "player" interface 
for each multimedia object thus no matter the object is known or unknown, the system 
always locate the player associated with the multimedia object. 

With respect to independent claim 10, as disclosed and argued in claim 1, Kauffman 
further discloses that each document includes execution script for displaying the 
contents of the page (col 2, lines 35-45). It is noted that Kauffman fails to use the same 
terminology: a document including information for controlling the display. However, it 
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would have been obvious to one of ordinary skill in the art at the time of the invention 
was made to have applied Kauffman because the execution script included in the 
document is for controlling the display of the contents of documents. 

With respect to claim 1 1 , which is dependent on claim 10, it would have been obvious to 
one of ordinary skill in the art at the time of the invention was made to recognize that in 
the multimedia documents including text, images, sound, the first file format or the 
second file format is selected from the group of file formats that include the textual file 
format, the image file format, and the sound format. 

With respect to claim 12, which is dependent on claim 10, as disclosed in claim 1 , both 
Berry and Kauffman apply the object-oriented concept thus the feature of inheritance is 
included in their method. 

With respect to claim 13, which is dependent on claim 10, due to applying the object- 
oriented concept, each object obviously has associated attributes and functions. 

With respect to claim 14, which is dependent on claim 10, as disclosed in claim 1 , it 
would have been obvious to one of ordinary skill in the art at the time of the invention 
was made to recognize that each page, as a portion of the document, is a data element 
arranged in the hierarchical document (Kauffman, col 4, lines 55-67; col 5, lines 1-15, 
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lines 58-63) thus the combination of these pages formes a part of the multimedia 
document. 

Claims 2-3, 7-8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kauffman and Berry as applied to claim 1 above, and further in viev^^ of Ando (US Pat 
No. 5,600,826, 2/4/97). 

Claims 2-3, 7-8 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kauffman and Berry as applied to claim 1 above, and further in view of Ando (US Pat 
No. 5,600,826, 2/4/97). 

With respect to claims 2 and 3, which are dependent on claim 1 , Kauffman and Berry do 
not disclose the steps of changing at least an object in the data file and adding at least 
an object to the data file. Ando provides a structure data processor for processing 
structured data of a tree structure in which data elements (logic objects) are arranged in 
the order of depth (logic sequence) in a structure document typically represented by 
ODA~Open Document Architecture. The structure data processor can perform the 
functions of editing, treating, printing and displaying on structured documents (col 6, 
lines 55-63). It is noted that Ando fails to explicitly disclose the changing and adding 
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objects. However, it would have been obvious to one of ordinary skill in the art at the 
time of the invention was made to have applied Ando because Ando provides the ability 
of editing objects which can comprise of changing and adding objects which are data 
elements arranged in a structured document. 

With respect to claim 7, which is dependent on claim 1 , Kauffman and Berry do not 
disclose each object has an address indicating a player that plays the object. Ando 
discloses each object has an object identifier that stores the position information of a 
data element (col 1 , lines 9-22). It would have been obvious to one of ordinary skill in 
the art at the time of the invention was made to have applied Ando because Ando 
provides the object identifier that stores the address for each object. 

With respect to claim 8, which is dependent on claim 1, Kauffman and Berry do not 
disclose the compressing information in each object. Ando discloses that a data 
compression/development device can, of course, be incorporated into a structured data 
processor of the invention or an external device. Such a configuration makes the 
system more advantageous in capacity, contributing to high-speed data transmission, 
which is obvious (col 6, lines 38-43). It is noted that Ando fails to explicitly disclose the 
compressing the information in each object. However, it would have been obvious to 
one of ordinary skill in the art at the time of the invention was made to have applied 
Ando because Ando shows the advantage of compressing of object information in 
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transmitting data thus motivating the including of the compressing step in the method of 
producing a multimedia document. 

Claims 5-6 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kauffman and Berry as applied to claim 1 above, and further in view of Johnson (US Pat 
No. 5,892, 847, 4/6/99). 

With respect to claims 5 and 6, which are dependent on claim 1 , Kauffman and Berry do 
not disclose the defining as well as the locating the update splash image within the data 
file. Johnson discloses a feature that the encoder creates a file format that segments or 
"layers" the compressed image. The layering of the compressed image allows the 
decoder to display image file segments, beginning with the data at the front of the file, in 
a coherent sequence which begins with the decoding and display of the information that 
constitutes the core of the image as defined by human perception. The core information 
can appear as a good quality miniature of the image and a full sized "splash" or coarse 
quality version of the image. The image then is displayed quickly to see details being 
added to the image as subsequent layers are received, decoded and added to the core 
image (col 4, lines 30-50). It would have been obvious to one of ordinary skill in the art 
at the time of the invention was made to have applied Johnson and combined to 
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Kauffman and Berry because Berry shows the process of displaying of a splash image 
in a multimedia document. 

Claims 15-16 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kauffman and Berry as applied to claim 1 above, and further in view of Brown (Using 
Netscape 2, 1995). 

With respect to claims 15 and' 16, which are dependent on claim 10, Kauffman and 
Berry do not disclose the document forms a code segment that receives image 
information, and wherein the image information is used to construct an image frame for 
a framed image that is a part of the multimedia document. Brown discloses the code 
segment to construct the image frame that is part of a multimedia document (page 773; 
page 774, figure 30.1 1 ; page 777). It is noted that Brown fails to disclose the decoder 
determines the image data format and encapsulates the framed image with the image 
frame. However, it would have been obvious to one of ordinary skill in the art at the 
time of the invention was made to have applied Brown because Brown provides the 
code for constructing a frame in a HTML document and also provides how the frame 
looks like according to the data format of the code. 
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Conclusion 

The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Katseff et al. (US Pat No. 5,822,537, 10/13/98) teaches a multimedia networked system 
detecting congestion by monitoring buffers' threshold and compensating by reducing 
video transmittal rate then reducing audio playback rate. 

Case et al. (US Pat No. 5,440,677, 8/8/95) teaches the method and apparatus for 
processing audio and graphic images to create an interleaved file suitable for use as a 
CD-ROM product. 

Guck (US Pat No. 5,864,870, 1/26/99) teaches a method for storing/retrieving files of 
various formats in an object database using a virtual multimedia file system. 
Piersol et al. (US Pat No. 5,745,910, 4/28/98) teaches a frame structure which provides 
an interface between parts of a compound document. 

Griffiths (US Pat No. 5,913,038, 6/15/99) teaches a system and method for processing 
multimedia data streams using filter graphs. 

Havens et al. (US Pat No. 5,732,263, 3/24/98) teaches the systems, methods and 
computer program products for generating and validating user defined object classes in 
an object-oriented programming environment after build time. 
Gustman (US Pat No. 5,813,014, 9/22/98) teaches a method and apparatus for 
management of multimedia assets. 
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Johnson (US Pat No. 5,892,847, 4/6/99) teaches a method and apparatus for 
compressing images. 

Gudmundson et al. (US Pat No. 5,680,619, 10/21/97) teaches the hierarchical 
encapsulation of instantiated objects in a multimedia authoring system. 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Cong-Lac Huynh whose telephone number is (703)-305- 
0432. The examiner can normally be reached on Monday through Friday from 8:00 AM 
to 4:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Michael Razavi, can be reached on (703) 305-4713. The fax number to this 
Art Unit is (703) 308-5403. 

Any inquiry of a general nature or relating to the status of this application should 
be directed to the Group receptionist whose telephone number is (703) 305-3900. 

Any response to this action should be mailed to: 

Commissioner of Patents and Trademarks 
Washington, D.C. 20231 
Or faxed to: 
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(703) 308-9051 , (for formal communications intended for entry) 

Or: 

(703) 308-5403 (for informal or draft communications, please label 
"PROPOSED" or "DRAFT") 

Hand-delivered responses should be brought to Crystal Park II, 2121 Crystal Drive, 
and Arlington. VA. Sixth Floor (Receptionist). 





10/21/99 



